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IDENTIF'iCATION  OF  SEIF -DESCRIPTION  SCALES 
FOR  DIFFERENTIAL  CLASSIFICATION 


BACKGROUND 

As  one  phase  of  the  major  research  effort  to  develop  an  improved 
Army  Classification  Battery  (ACB),  research  continues  on  two  experimental 
self -description  noncognitive  instruments  designed  to  contribute  to 
differential  prediction  of  performance  in  Army  training  programs --Forms 
2  and  7  of  the  experimental  Army  Differential  Aptitude  Series  (ADAS). 
Research  Memorandum  58-6  (Johnson,  ICLieger,  and  Frankfeldt,  1958)  describes 
the  construction  and  composition  of  the  two  instruments.  Currently,  seven 
predetermined  noncognitive  scales  are  being  validated  for  selected  Army 
MOS  and  job  areas  as  a  part  of  the  research  under  Project  NCT  a-17»( 
''Evaluation  of  experimental  predictor  tests  to  supplement  the  ACB. 

The  purpose  of  the  present  project  was  to  develop  ADAS-2  and  ADAS-7 
empirical  scales  designed  to  differentially  predict  performance  in  a  broad 
range  of  MOS  in  the  Electronics,  General  Maintenance,  Motor  Maintenance, 
and  Clerical  occupational  areas.  To  serve  the  purposes  intended,  each 
scale  should  (l)  be  effective  for  a  substantial  number  of  related  MOS,  and 
(2)  possess  differential  predictive  value  for  MOS  in  a  given  occupational 
area,  in  contrast  to  MOS  in  other  occupational  areas. 

The  present  Research  Memorandum  describes  the  development  of  11  new 
noncognitive  scales  for  ADAS-2  and  ADAS-7 --five  against  a  training  criterion 
and  six  against  later  performance  on  the  job. 


METHOD 


EXPERIMENTAL  INSTRUMENTS  ADAS-2  and  ADAS-7 

Self -Description  Blank,  ADAS-2  (DA  PT  3391)  contains  395  noncognitive 
job  connected  items  grouped  in  nine  sections.  ADAS-7  (DA  PT  339®)  contains 
210  statements  of  attitudes,  experiences,  etc.,  each  providing  for  alternative 
responses:  (a)  describes  me,  (B)  does  not  describe  me. 


The  nine  types  of  item 
SECTION 

NUMBER  ITEM  NUMBERS 

1  1-95 

2  96-135 


contained  in  ADAS-2  are  as  follows: 

CONTENT  AND  RESPONSES 

Attitude  toward  jobs,  activities,  etc: 

(L)  like,  (l)  indifferent,  (D)  dislike 

Self-evaluation  of  competence  in  certain  Jobs 
(Y)  good  at,  (D)  don't  know,  (N)  not  good  at 
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136-145 


Of  three  activities  listed,  choose  one  Judged 
best  at:  (a),  (b),  or  (c) 

4  146-160  Competence  In  specified  classes  or  shop  courses: 

(A)  outstanding,  (B)  not  outstanding,  (c)  did 

not  take  course 

5  l6l-190  Statements  about  jobs:  (A)  agree,  (b)  disagree 

6  191-215  Of  three  tasks  listed,  choose  one  preferred: 

(A),  (B),  or  (C) 

7  216-220  Of  three  topics  listed,  choose  one  most  interesting 

to  discuss:  (A),  (b),  or  (c) 

8  221-285  Activities  engaged  in  prior  to  age  18: 

(Y)  yes,  (N)  no 

9  286-395  Descriptive  statements  re  attitudes,  experience, 

etc:  (Y)  apply,  (n)  do  not  apply 

CRITERIA 

For  all  MOS  except  Automotive  Maintenance  Helper  (630)  and  Basic  Army 
Administration  (710),  the  training  criterion  was  final  course  grade--a  weighted 
combination  of  vritten  examination  results  and  practicum  evaluation. 

For  the  research  studies  on  Common  Specialist  Training  Programs  630 
and  710  (Helme,  Denton,  and  Anderson,  1962;  1963),  however,  variations 
occurred  in  the  types  of  evaluation  submitted  by  the  different  installations 
supplying  the  samples  for  the  study.  Consequently,  a  converted  training 
score  was  derived,  applicable  to  all  samples  being  combined  for  the  MOS  630 
and  the  MOS  710  samples  of  the  present  6tudy.  The  converted  score  was  based 
on  the  tie-back  of  obtained  final  course  grades  to  scores  achieved  on  a 
reference  test  (the  Automotive  Information  Test  for  MOS  630  and  the  Verbal 
Test  for  710). 

For  the  follow-up  studies,  the  criterion  measure  was  an  average  of  peer 
and  supervisor  on-Job  ratings.”  * 

SAMPLES 

Data  used  in  the  present  study  were  originally  collected  under  two 
earlier  projects  (Helme,  Fitch,  and  Olans,  1959): 


Data  collection  for  the  evaluation  of  experimental  teste  of  abilities 
to  supplement  the  ACB  (NCT  a-12).  Phase  I  (November  1957  -  April  1958) 
included  administration  of  ADAS-2  and  ADAS-7  to  the  enlisted  men  slated 
for  assignment  to  57  school  courses.  Phase  II  (April  -  November  1958) 
provided  additional  cases  required  for  item  analysis,  with  concentration 
of  cases  in  three  Job  areas:  electronics  repair,  mechanical  repair,  and 
communications -clerical.  In  both  phases,  men  were  tested  toward  the 
latter  part  of  basic  training  after  decisions  bad  been  made  on  their  train¬ 
ing  assignments.  Installations  involved  were  Forts  Pix,  Jackson,  Chaffee, 
Leonard  Wood,  Carson,  and  Ord. 

The  prediction  of  success  in  selected  Common  Specialist  Training 
Programs  (NCT  a-32) .  During  five  months  of  1958,  ADAS-2  and  ADAS-7  were 
administered  to  enlisted  men  assigned  to  two  entry  Common  Specialist 
Training  Programs:  Automotive  Maintenance  Helper  (MGS  650)  and  Basic  Army 
Administration  (MOS  710  and  711 . 1 ) .  The  installations  represented  were 
those  listed  above,  with  the  exception  of  Fort  2 lx. 

Or -the -Job  evaluations  examinees  were  obtained  by  mail  order. 

Loss  of  cases  during  the  Training  period  and  further  losses  during 
the  on-the-job  period  required  the  combining  of  related  MOS  samples  into 
MOS  groups  of  adequate  size  to  provide  reasonably  stable  item  indices. 

The  resulting  training  and  Job  effectiveness  criterion  samples  are  shown 
in  Table  1.  Because  of  the  large  size  of  the  Common  Specialist  Program 
samples,  they  v ere  divided  into  random  halves  which  were  used  as  separate 
samples.  This  procedure  was  followed  with  both  training  and  Job  criterion 
samples. 


RATIONALE  FOR  SCALE  CONSTRUCTION 

In  developing  cognitive  measures  for  differential  classification,  the 
selection  of  MOS  to  be  combined  to  form  occupational  groups  is  based  on 
the  Job  functions  reflected  in  training  for  the  MOS,  as  well  as  the 
validity  of  the  measures.  No  such  firm  basis  in  available  for  forming 
occupational  groupings  when  noncognitive  measures  are  being  developed. 

The  general  approach  in  the  present  research  was,  first,  to  attempt 
to  use  agreement  in  item  validity  coefficients  for  the  various  MOS  to 
determine  occupational  groupings.  Second,  a  test  was  made  of  the  validity 
generalization  across  the  MOS  within  each  occupational  group. 

This  approach,  however,  required  recognition  of  a  basic  difficulty 
inherent  in  validity  generalization --any  test  item,  if  tried  out  on  10 
different  samples,  is  Jikely  to  show  a  validity  coefficient  for  one  of 
the  samples  which  is  significantly  different  from  zero  at  .10  level  even 
if  the  true  validity  of  that  item  is  zero.  In  recognition  of  this,  no 
item  was  accepted  as  valid  unless  it  had  coefficients  at  the  .10  level  of 


Table  1 


ADAS -2  AND  ADAS-7  ITEM  ANALYSIS  SAMPLES 


Training  Samples  | 

Job  Effectiveness  Samples 

MOS 

N 

Source 

MOS 

N 

Source 

053 

223 

230,250 

271,281 

293 

294,296 

311 

313 

321 

41+0 

511 

530 

612 

630A 

65OB 

670,680 

701 

7iO,711A 

710,711B 

721,724 

722 

723 

730 

283 

71 

63 

70 

178 

230 

97 

146 

96 

156 

177 

104 

228 

601 

601 

153 

58 

646 

647 

91 

524 

254 

l4l 

a -12  (II) 

a -12  (il) 

a -12  (II) 

a -12  (II) 

a-12  (II) 

a -12  (II) 

a  -12  (II) 

a-12  (II) 

a-12  (II) 

a-12  (I+II) 

a-12  (I) 

a-12  (I+II) 

a-12  (II) 

a-32 

a-32 

a-12  (II) 

a-12  (II) 

a-32 

a-32 

a-12  (II) 

a-12  (II) 
a-12  (II) 
a-12  (II) 

053 

51 

a-12  (I+II) 

220 , 223 , 225 , 227 , 240 , 24  3 , 244 , 
246,247,248,250,251,252,253, 
254 

153 

a-12  (I+II) 

271,273,281,282, 284 , 294 , 296 

171 

a-12  (I+II) 

293 

85 

a-12  (I+II) 

310,311,313 

51 

a-12  (I+II) 

320,321,323 

126 

a-12  (I+II) 

350,351,357,370,371,372 

51 

a-12  (I) 

440,510,511,515,530 

71 

a-12  (I) 

612 

50 

a-12  (II) 

620,621,622,623,624,630,631, 
632, 633, 634, 635 -A 

142 

a-32 

620 , 621 , 622 , 623, 624 , 630, 631 , 
632,633, 634,635-B 

142 

a-32 

670,671,672,673,674 

77 

a-12  (II) 

701,703, 710, 711,712, 713, 714 , 
716, 717, 718 -A 

163 

a-32 

701,703,710, 711 ,712,713, 714 , 
7l6,717,7l8-B 

163 

a-32 

721,723,724 

71 

a-12  (II) 

722 

l4l 

a-12  (II) 

Total  5395 

|  Total  1708 
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significance  for  a  number  of  single  MOS  sufficient  to  reach  at  least  the  .05 
level  of  probability  of  difference  from  zero  across  the  total  number  of  MOS 
in  the  occupational  group.  For  example,  in  a  training  criterion  occupational 
group  of  six  MOS,  the  occurrence  of  coefficients  valid  at  the  .10  level 
for  three  single  MOS  yielded  a  probability  value  of  .016.  As  will  be  dis¬ 
cussed  later,  the  lack  of  stability  and  the  relative  lack  of  differentia¬ 
bility  among  Job  performance  criteria  precluded  the  use  of  restricted 
occupational  groupings  as  the  basis  for  selecting  items  in  Job  criterion 
scale  development. 


DEVELOPMENT  OF  TRAINING  CRITERION  SCALES 
PRELIMINARY  GROUPING  OF  MOS 


The  initial  combining  of  MOS  samples  into  broad  occupational  groups 
was  based  on  the  frequency  with  which  the  same  ADAS-2  items  were  valid 
for  certain  MOS  samples  and  not  for  others.  For  each  pairing  of  19  MOS 
samples,  dr.  tun,  let emi nation  was  male  of  the  frequency  cf  statistically 
significant  items  (.10  level)  shared  by  both  members  of  the  pair  and  the 
significance  of  the  deviation  of  these  frequencies  from  the  expected.  MOS 
which  shove i  definite  interrelationships  in  s 'cared  valid  items  and  in  training 
contemn  were  combined  into  tentative  occupational  groupings,  as  follows: 


A 

B 

C 

D 

E 


Group 


Eleetr  ni ce 

053 

Mechanical 

440 

Clerical 

721 

Electronics 

Ope  oat  or 

271 

Heavy  Coast* 

•u  tiors 

321 

MCS  Sample^ 

£23  ••  230  -  294  -  311  -  313 

511  -  530  -  670 

’723  -  730  -  72?  -  701 

233 

612 


REFINEMENT  OF  OCCUPATIONAL  GROUPS 

The  five  tentative  MOS  groupings  based  on  shared  valid  items  were 
tested  for  (l)  the  degree  of  affinity  among  the  MOS  within  a  group  and  (2) 
the  degree  of  discrimination  between  groups.  As  the  first  step,  selection 
was  made,  for  each  group,  of  ALAS  item  alternatives  with  validity  coef¬ 
ficients  which  (l)  were  significant  at  the  .10  level  for  one  or  more 
MOS  in  the  group,  (2)  were  not  flagrantly  contradicted  by  any  other  MOS  in 
the  group,  and  (3)  tended  to  differentiate  that  group  from  all  other  groups. 
In  addition,  consideration  was  given  to  the  consistency  of  item  content 
with  the  training  content  of  the  MOS  involved.  A  total  of  193  alternatives 
(from  ]8.1  items)  resulted  from  this  procedure. 


Descriptive  titles  identifying  the  Job  functions  of  the  MOS  sampl.es  referred 
to  by  number  throughout,  the  text  are  shown  in  tables  of  the  Appendix. 
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Next,  for  each  MOS,  the  validity  coefficients  obtained  on  the  195 
selected  alternatives  were  coded  on  a  7~P°in^  8cale  validity.  For  each 
group  separately,  an  inter-r  matrix  was  computed  for  validity  scale  values 
obtained  on  the  195  item  alternatives  in  each  MOS  sample  within  the  group. 

Table  2  presents  the  resulting  matrixes  for  the  five  occupational^ groups. 

The  MCS  groupings  for  Groups  A,  B,  and  E  proved  to  be  satisfactory,  with 
inter-r's  ranging  from  .22  to  .55  for  A,  .26  to  .40  for  B,  and  an  r  of  .44 
for  the  two  MOS  samples  In  Group  E.  MOS  721  (Communications  Center  Operator; 
showed  low  r's  (-.06  to  .07)  with  the  other  MOS  of  Group  C,  and  was  eliminated 
from  that  group..  The  r  of  .20  between  MOS  271  (Fixed  Station  Receiver  Repairman) 
and  295  (Radio  Relay  and  Carrier  Operator),  which  comprised  Group  D,  did  not 
justify  a  separate  Group  D.  In  order  to  locate  more  satisfactory  group 
membership  for  MOS  721,  271,  and  295,  the  validity  scale  values  obtained  for 
these  MOS  were  correlated  with  those  obtained  for  two  representative  MOS  in 
each  of  Groups  A,  B,  C,  and  E.  The  obtained  r's  justified  adding  MOS  271 
and  295  to  Group  C  and  the  elimination  of  MOS  721  from  further  consideration 
(Table  5). 


Table  2 

RELATIONSHIPS  AMONG  MOS  WITHIN  OCCUPATIONAL  GROUPS,  IN  TERMS 
OF  VALIDITY-SCALE  VALUES  FOR  195  SELECTED  ITEM  ALTERNATIVES 

GROUP  A  -  ELECTRONICS  GROUP  B  -  MECHANICAL 


MOS  055  225  250  294  511  515 

Average 

055 

-  .25  .49  .43  .50  .42 

.42 

225 

-  .22  .31  .39  .32 

.30 

250 

-  .27  .37  .27 

.32 

294 

-  .39  -45 

.37 

311 

-  .53 

.44 

313 

- 

.40 

GROUP  C  -  CLERICAL 

MOS 

721  723  730  722  701  Average 

721 

.  .03  .07  -.06  .03 

.02 

723 

-  .45  .42  .31 

.30 

730 

■*  •  -  .yr  .25 

.28- 

722 

-  .33 

.26 

701 

- 

.23 

MOS  440  511  550  670  Average 


440  - 

.40  .37 

.33 

.37 

511 

-  .37 

.26 

.34 

530 

* 

.38 

.37 

670 

- 

•  32 

GROUP  P  -  ELECTRONICS  OPERATORS 

MOS  295  271 
295  -  -.20 
271 


GROUP  E  -  HEAVY  CONSTRUCTION 

MOS  521.  612 
521  -  .44 
612 
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Table  3 


RELATIONSHIP  BETWEEN  MOS  271,  295  ,  721  AND  REPRESENTATIVE  MOS  IN 
OCCUPATIONAL  GROUPS  A,  B,  C,  AND  E,  IN  TERMS  CF  VALIDITY  SCALE 
VALUES  FOR  193  SELECTED  ITEM  ALTERNATIVES 


MOS 

Group 

A 

Group 

B 

Group 

1  C 

Group 

E 

053 

311 

440 

530 

723 

730 

321 

612 

271 

.26 

.22 

.06 

.08 

.30 

.29 

-.17  • 

-.15 

293 

.22 

.15 

.16 

.15 

.26 

.19 

-.01 

.04 

7?1 

.14 

.24 

.13 

.15 

.03 

.07 

.07 

.03 

To  i'.eure  adequate  discrimiaat I .  among  the  revised  occupational  groups, 
inter-rrs  of  validity  .scale  values  were  computed  for  two  representative 
103  from  each  of  the  four  groups  (Table  4). 

Table  4 

INTER -R  MATRIX  BHOWIW'-  DU’f'ERENIATlON  AMONG  REPRESENTATIVE 
GROUP  SAMPLES  IN  TERMS  OF  VALIDITY  SCALE  VAL'TES  FOR  193 
SELECTED  1TIM  ALTERNATIVES 


Occupational  Group 

MOS 

m 

T* 

1 

C 

E 

£ 

44c  530 

723  730 

321  612 

A  -  Electronics 

053 

311 

.50 

.26  .34 

.27  .36 

.24  .24 

.05  .15 

-.31  -.14 
-.25  -.12 

B  -  Mechanical 

440 

530 

•  37 

.07  -.01 
.22  .13 

.06  .15 

-.10  -.01 

C  -  Clerical 

723 

730 

.45 

-.07  -.19 
-.13  -.30 

E  -  Heavy 

Construction 

321 

612 

.44 
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For  each  group,  the  member  MOS  showed  lower  relationship  with  MOS  from 
other  groups  (r’s  from  -.51  to  .56)  than  with  each  other  (r's  from  .57  to  .50). 
Group  E  showed  highest  discrimination  from  other  groups,  with  average  r's  of 
-.20  with  Group  A,  .10  with  B,  and  -.17  with  C.  Least  discrimination  occurred 
between  Groups  A  and  B  (average  r  of  .51). 

Data  from  the  Common  Specialist  Training  Program  MOS  samples  630-A,  65O-B 
(Automotive  Maintenance  Helper)  710-A,  and  710-B  (Basic  Army  Administration) 
were  treated  separately  from  the  other  samples  because  of  the  difference, 
discussed  earlier,  in  the  training  criterion  used  for  item  validation.  For 
65c  ani  710,  item  alternatives  were  selected  whose  point  biserial  r's  for  the 
A  and  B  rand-- a  halves  averaged  .15  or  higher.  From  the  resulting  630-A  and 
650-B  pools,  items  were  selected  to  augment  the  Group  3  (Mechanical)  item  pool. 
The  710-A  and  710-B  items  were  added  to  the  Group  C  (Clerical)  item  pool. 

Final  occupational  groups  and  the  MOS  samples  included  under  each  were 
as  follows: 

Group  MOS 

I  Electronics  -  T  055-225-250-294-312-515 

XI  Mechanical  -  T  440-511-550-670-650A-630B 

III  Heavy  Construction  -  T  521-612 

IV  Clerical  -  T  271-725-750-722-701 -295-710A-710B 


CONSTRUCTION  OF  FINAL  SCALES 

Final  pools  of  item  alternatives  significantly  valid  at  the  .10  level 
or  better  were  selected  for  the  occupational  groups,  using  probability  values 
as  ir.dica+ed  below: 


Grc  up 

Required  Number  of  MOS  Samples 
With  Validities  at  .10  level 

Probability 

Value 

I 

-  Electronics 

5  out  of  the  6 

.016 

II 

-  Mechanical 

3  "  "  "  6 

.016 

III 

-  Heavy  Construction 

2  ti  »»  »»  2 

.010 

IV 

-  Clerical 

4  "  "  "  8 

.005 

Further  refinement  of  the  four  pools  resulted  in  the  four  differential 
training  criterion  scales  shown  in  Table  A-l  through  A-4  of  the  Appendix. 

An  attempt  to  derive  a  "General"  scale  revealed  that  there  were  too  few 
items  valid  across  all  MOS  samples.  Instead,  item  alternatives  which  were 
valid  across  Groups  I  and  II  and  relatively  unique  to  those  groups  were  used 
to  derive  the  Electrical -Mechanical  scale  shown  in  Table  A-5  of  the  Appendix. 
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DEVELOPMENT  OF  JOB  EFFECTIVENESS  CRITERION  SCALES 


Attrition  occurring  between  end  of  training  and  on-the-job  assessment 
required  further  grouping  of  related  MOS  trairing  samples  in  order  to  obtain 
mere  stable  N's  for  l6  job  effectiveness  samples. 


DETERMINATION  OF  METHOD  FOR  GROUPING  MOS 

In  comparisrn  with  training  criteria,  job  criteria  for  different  MOS 
are  less  predictable  and  are  less  clearly  differentiated  from  one  another 
--factors  which  contribute  to  across-MOS  Instability  of  item  validities. 

Thus,  it  was  less  likely  that  determination  of  which  job  criterion  MOS 
samples  tc  combine  to  form  occupational  groups  could  be  based  on  the  fre¬ 
quency  with  vhicv  the  same  itens  are  valid  fur  two  different  MOS  samples-- 
-.he  procedure  used  in  forming  the  training  criterion  MOS  sample  group. 

la  recognition  :f  +  he  limitations  inherent  in  item  validity  coefficients 
based  on  Job  criteria,  a  preliminary  test  was  made  of  maximum  possible  valid¬ 
ity  generalization  across  two  j.c  criterion  MOS  samples  by  comparing  the 
coefficients  obtained  os.  the  -am-  items  in  the  two  random  halves  of  the  MOS 
630  samples  'by:  A  ani  63O-B).  being  the  .10  ^evtl  of  significance,  deter¬ 
mination  was  mat-  of  the  extent  to  which  the  s-t  of  items  selected  on  sample 
630-A  corresponded  t. :  the  set  selected  on  sample  6%-B.  The  same  procedure 
was  followed  for  samples  710  A  and  710-B.  A  test  of  the  A  vs  P  distributions 
yielded  contingency  coefficients  which  were  lower  than  would  be  expected 
from  random  halves:  .29  for  630  A  vs  £  and  .07  for  710  A  ve  B. 

From  these  results  it  was  apparent  that  with  job  criterion  MOS  samples, 
the  degree  ::f  item  validity  ag’  eat  between  two  mvS  samples  couua  not  be 
used  as  a  basis  for  terming  occupational  grouping? .  Decision  was  male,  there¬ 
fore,  t  -<  rely  up:  a  the  basic  MOS  gr-jplags  derived  empirically  fer  the 
occupational  gre  ins  f  tr  the  training  criterion. 

With  some  adjustments,  required  to  obtain  relatively  stable  N's,  the 
job  criterion  occupational  groups  with  the  identifying  MOS  for  the  Job 
Criterion  samples  in  each  were  set  up  as  follows: 

Group  MOS 

I  -  Electronics  -  J  053-223-294  (+271) -3U  (+313) 

II  -  Mechanical  -  J  440  (+512,  530)-670-630A-630B-351 

III  -  Heavy  Construction  -  J  321-612 
IV  -  Clerical  -  J  722-723-293-710  (+70l)A-710  (+701)B 

Insufficient  cases  in  MOS  730  (included  in  training  criterion  Group  IV) 
which  had  criterion  data  accounts  for  its  omission  from  Job  Group  IV. 
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In  recognition  of  the  evidence  cited  early  that  for  Job  criterion 
samples  an  item  had  to  be  valid  for  more  than  two  MOS  in  order  to  promise 
stable  validity,  decision  was  made  to  require  item  validity  at  the  .05 
'..evel  of  significance  for  at  least  5  out  of  the  total  1 6  MOS  samples--a 
probabili+y  value  of  .034.  Applying  this  validity  criterion,  151  items 
were  selected  from  the  total  of  605  ADAS-2  and  ADAS-7  items. 

A  test  was  made  of  the  maximum  possible  stability  across  samples  of  the 
selects!  items,  again  using  the  A  and  B  samples  of  MOS  650  and  of  710»  For 
each  item,  the  alternative  with  highest  coefficient  was  used.  Separate 
A  and  B  tabulations  were  made  of  the  validity  coefficients  obtained  on  the 
alternatives  so  selected.  The  tabulated  A  and  B  coefficients  (in  .05  intervals) 
were  then  correlated.  This  test  was  duplicated  for  MOS  710-A  vs  710-B.  The  A 
vs  B  eo rr^ation  coefficients  obtained  were  .44  for  MOS  630  and  .15  for  710 — 
evidence  of  tncr-aeed  stability  obtained  by  restricting  the  item  pool  to  those 
items  pV.vir.g  significant  incidence  of  validity  across  the  full  set  of  MOS 
samples  (3  out  of  l6).  The  coefficients  were  also  based,  of  course,  on  more 
ref inei  lot ervals . 


CONSTRUCTION  OF  FINAL  Sl'-ALES 

Using  the  151  items  selected  by  applying  the  validity  criterion  decided 
upon  (items  at  .05  level  for  3  out  of  she  l6  Job  MOS  samples),  allocation  to 
job  criterion  occupational  group  pools  was  made  for  all  valid  alternatives 
(.05  level).  A  value  was  assigned  each  alternative,  reflecting  the  extent 
to  which  it  was  valid  for  all  MOS  in  the  group  to  which  it  was  assigned  and 
was  less  valid  for  MOS  in  other  groups. 

Additional  refinements  resulted  in  the  selection  of  a  total  of  155 
alternatives  for  the  f:ur  occupational  group  pools.  Within  each  pool,  the 
alternatives  were  then  classified  according  to  the  extent  to  which  their 
validity  was  unique  for  their  assigned  group,  was  shared  by  one  other  group, 
or  was  shared  by  two  others.  With  further  refinements,  final  selections  of 
20  keyed  alternatives  were  made  for  each  of  the  four  occupational  groups. 

Table,  5  shows  the  number  of  final  selections  for  the  Job  Criterion  scales, 
classified  according  to  their  uniqueness  to  the  OctdpAtional  -area  -scale  for 
which  they  were  designed.  For  the  Electronics,  Mechanical,  and  Clerical  scales, 
all  keyed  item  alternatives  were  acceptable  oniy  in  their  respective  groups. 
Those  exclusive  to  the  Heavy  Construction  area  were  supplemented  by  five 
alternatives  which  were  valid  for  both  Heavy  Construction  and  Electronics, 
and  by  six  which  were  common  to  Heavy  Construction  and  Mechanical .  General 
Scale  I  selections  were  from  item  alternatives  valid  for  both  the  Mechanical 
and  Clerical  areas — areas  of  contrasting  characteristics.  General  Scale  II 
alternatives  were  valid  for  three  out.  of  the  four  occupational  areas. 

Tables  A-6  through  A -11  of  the  Appendix  list  the  ADAS-2  and  ADAS-7  alter¬ 
natives  comprising  the  six  Job  Criterion  Scales,  with  validity  data. 
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SPECIFICITY  OF  ITEMS  SELECTED  FOR  JOB  CRITERION  SCALES 


Identification 
of  Scale 

Total 

No. 

Items 

Valid  only 
for  one 
_ group _ 

Valid  for  two  « 

roups 

Valid  for 
three 
groups 

HC-E 

HC-M 

M-C 

a 

ED 

-2  -? 

QQ 

-2  -7 

Electronics  -  J 

20 

16 

4 

Mechanical  -  J 

20 

20 

- 

Heavy  Construction-  J 

20 

8 

1 

5  - 

5  5 

Clerical  -  J 

20 

14 

6 

Genera!  I  -  -J 

20 

„ 

8  12 

General  II  -  J  • 

15 

- 

- 

9  6 

Identifying  symbols  for  the  Training  and  Job  Criterion  Keys  are  shown  in 
Table  6. 

Table  6 


TOA3NINL  AND  JOB  CRITERION  EMPIRICAL  KEYS  FOR  ADAS -2  AND  ADAS-? 


Total 

No. 

Items 

Key  Title 

TX 

Number 

No. 

Items 

TX  . 
Number 

No. 

Items 

A.  Training  Criterion  Keys 

ELECTRONICS  -  T 

1003  t 

25 

1.003  a 

30 

MECHANICAL  -  T 

1004  b 

19 

1004  a 

30 

HEAVY  CONSTRUCTION  -  T 

1005  b 

14 

1005  a 

30 

CLERICAL  -  T 

1.006  b 

25 

1006  a 

30 

ELECTRICAL-MECHANICAL  -  T 

100?  b 

26 

1007  a 

Hi 

30 

B.  Job  Criterion  Keys 

ELECTRICAL  -  J 

1008  b 

1008  a 

4 

20 

MECHANICAL  -  J 

1009 

- 

- 

20 

HEAVY  CONSTRUCTION  -  J 

1010  t 

1010  a 

4 

20 

CLERICAL  -  J 

1011.  b 

14 

1011  a 

6 

20 

GENERAL  I  -  J 

1012  b 

8 

1012  a 

12 

20 

GENERAL  II  -  J 

1013  b 

9 

1013  a 

6 

15 
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Item  Validity  Coefficients  and  Difficulty  Values  of  Item  Alternatives  of 
Training  and  Job  Criterion  Scales. 


Table  A-l  through  A-5.  Empirical  Training  Criterion  Scales 
Table  A-6  through  A -11.  Empirical  Job  Criterion  Scales 
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EMPIRICAL  TRAINING  CRITERION  SCALE:  ELECTRONICS  -  T  <TX  1003  a  &  b) 


Validity  Coefficients  &  Difficulty  Values 
(decimals  omitted) 
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Table  A-2  (continued) 
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